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ABSTRACT 



This study addressed the writing of college educated 



officers compared to their overall performance in an introductory 
Army course. The effects of an effective writing (communicativfe 
skills) program and a remedial enrichment program were also examined. 
A total of 137 U.S. Army lieutenants, who were students in the 
15-week Military Police Officer Basic Course during January through 
June of 1987, completed both indirect and direct measures of writing 
skills. The indirect measure was the Test of Standard Written English 
(TSWE) , and the direct measures consisted of six different written 
exercises. Officers scoring a scaled score of 40 or above on the TSWE 
were sorted into groups of active and reserve component officers and 
then were randomly assigned to two experimental groups. All officers 
scoring below a scaled score of 40 had to take the enrichment 
program. Ninety-eight of the students were placed in the writing 
enrichment program. The enrichment program significantly improved the 
writing skills of officers with initially deficient skills. However, 
the enrichment prograun improved neither the writing skills of 
officers initially scoring higher on the initial indirect measure nor 
their performance in the overall course. There was a significant 
relationship between the indirect and direct assessment techniques. 
The indirect assessments provided a statistically significant 
predictive measure of overall course averages. The results support 
the usefulness of remedial writing programs with irdirect tests of 
writing performance; effective writing progrejns would significantly 
improve the productivity of college educated professionals. Four data 
tables, a 29-item list of references, and the rommunicative skills 
grade sheet are included. (RLC) 
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ABSTRACT 

One hundred thirty seven lieutenants oompleted both indirect 
&nd direct measurefi of writing skilis. Of these students, 98 were 
placed in a writing enrichment program. The Test of Standard 
Written English (TSWE) was the indirect measure. The direct 
measures consisted of six different written exercises. The 
enrichment program significantly improved the writing skills of 
officers with initially deficient skills. There was a significant 
relationship between the indirect and direct assessment 
h^ehiiiiiU^^ : The indirect assessments also provided a statistically 
significant predictive measure. of overall course averagers. 
Support was provided for the usefulness of remedial writing 
programs and of indirect tests of writing 
performance* 
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EVALUATIOH ISSUES RELATED TO WBITIHQ SKILLS 
OF COLLEGE EDUCATED PROFESSIONALS 

This study addresses the wpiting of college educated officers 
compared to their overall performance in an introductory Army 
course. The effects of an effective writing program and a 
remedial enrichment program are also examined. This study 
provides insight into the witing skills of college educated 
professionals as they move from the college world. 

The problem with writing skills is well documented. The 1975 
Newsweek article, 'Why Johnny Can't Write/ is a classic 
description. •Willy-nilly, the U.S. educational system is 
*?pawning a generation of semili terate* (Shells, 1975, p. 58). The 
National Council on Excellence in Education (1983) reported, 
•Business and military leaders complain that they are required to 
spend millions of dollars on costly remedial education and 
training programs in such basic skills &s reading, writing, 
spelling, and computation* (pp. 8-P) . Ronalds (1979) noted 
several leading business colleges have taken actions based on 
business executives "discovering that a murky memo wastes the time 
of staff and of high-priced managers and tha^ poor communications 
can harm a company's image in the eyes of the public and the 
government* (p. 73) . 

The military has the same problems. An Air Force document 
noted the dollar cost. *The Air Force turn out a staggering 500 
million pages of writing each year. The cost in salary time to 
read all that paperwork Just once comes to 1120 million* 
(Department of the Air Force, 1980, p. v) . The Army defined a 
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standard for efftctive witint mhich clotaly matcbei tbt 
requirements in business, 'Effective writing is writing tbat can 
be understood in a single rapid reading and is generally free of 
errors in grammar, mechanics, and usag^* (Department of the Army, 
1985, April, p. 3) . 

On a personal note, I have been supervising college educated 
military officers since 1978 and feel tbeir major professional 
deficiency is the inability to write clearly and concisely. The 
result is that correspondence has to be written and rewritten, at 
considerable loss "^.f productivity. Frequently, documents elicit 
inappropriate responses because the intent of the document is 
unclear. Again, time is wasted. 

Enrichment Programs 

The message appears to be that something has to be done to 
improve wpiting skills to prevent the loss of dollars and 
productivity. While a va^^iety of basic writing programs have been 
studied, David and Stine (1984) conducted one of the few studies 
on the effectiveness of short enrichment courses for adult 
writers. Their subjects were taught for two periods of 2 1/2 
hours. David and Stine compared the results to the effectiveness 
of a 30-hour college writing course. The short course included 
rules of grammar, punctuation, and spelling; guidelines for 
concise, clear writing; audience analysis; and direct, negative, 
ai*>d persuasive letters and memos. The college course assumed 
proficiency in grammar, punctuation, and spelling. 
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David and Stine nottd that the a|c and educational levels of 

the two groups were 5urpri8in|ly similar. Data from three groups 

were compared: a college course control group that got the 30--hour 

college writing course; a treatment group that got the college 

course and the instruction on mechanics given to the adults in the 

short course, and the adults in the short course. Pretest me^n 

scores for the three groups were not significantly different. All 

thrive groups showed improvement on posttests. 

However, short course participants gained slightly more than 
college experimental students given the saM instruction in 
mechanics. The short course participants gained more than 
three times as much as the colle<« control students who had 
not received direct instruction on mechanics, (p. 17) 



Indirect and Direct Measures of Writing Skills 



A major problem with any evaluation is the method of 

assessment. This problem is especially acute for an evaluation of 

writing skill. The literature does not provide definitive 

guidance on assessment of writing skills is limited. Lutt (1983) 

wrote, "I can find fewer than 200 item of research on the 

assessment of writing. . . And many of the studies are 

incomplete, flawed, and simply badly done. In short, when we turn 

to the research literature for answers to our questions, we find 

little to help us" (p. 6) . 

Direct assessment requires that aci;ual essays be written and 
usually such essays are read and scored independently by two 
or m^re readers. Indirect assessment , sometimes called 
objective assessment, requires no writing at all — the 
examinee only responds to stimuli in a multiple-choice 
format. Both direct and indirect assessment of writing 
skills have proved to be successful, but both have their 
advantages and disadvantages. (Breland & Qaynor, 1979, p. 
119) 



I) 



Colltgc EduGAtftd WpiUrs 

6 



Sptcif iCAtion of a atandArd mathod of avaXuAting vn^iting in 
difficult. Spandel and Stiggina (1081) aummarized soma kay 
advantages and disadvantages of direct and indirect assessment. 

Direct assessment techniques provide more information about the 
student's writing proficiency, more closely match real world 
writing tasks, have the potential for developing positive user 
attitudes, have relatively low development coats, and have high 
face validity. The disadvantages of direct assessment techniques 
are the potential lack of uniformity regarding the proficiencies 
assessed and the higher cost of scoring. Indirect assessment 
techniques have higher scoring reliability, have a relatively low 
scoring cost, and can exert a high degree of control over the 
skills assessed. The disadvantages of indirect assessment 
techniques are the reliance on reading and the lack of face 
validity. Halpin and Halpin (1982), Braddock, Lloyd-Jones, and 
Sheer (1063), Scherer (1985), French (1061), and Breland (1083) 
have concurred with these basic advantages and disadv>:^ntages. 

tfoyes, Sale, and Jtalnaker (1045) favor the use of 
standardized tests for measuring writing skills. Clark (1080) 
described their increasing popularity. 

Diedrich (1046) and Eley (1055) favor the use of direct 
assessment. O'Donnell C >84) and Huot (1000) described their 
increasing popularity. 

Breland and Qaynor (1070) defended direct assessment, but 
only when multiple samples, and multiple readings of each sample, 
are obtained. 'Usually, however, such elaborate direct assessment 
techniques cannot be used and, consequently, practical interest 
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aiUKt focu« on ttchnlquts requiring Ittt tint And tffort* (p. 120). 
Thtfe authors afrtt and favor tht uit of Indirtct affltMMntf whtn 
they can be shown to be at valid as direct aeaauref . The relative 
validity of indirect and direct meaiures renaine an open iisue. 

Research Questiong 

The following research questions were investigated in this 

study: 

Research Question 1: For officerr scoring less than 40 on 
the initial indirect measure and who take the communicative skills 
and enrichment programs, are there any statistically significant 
differences between the scores on indirect measures of writing 
skills, taken at the start and at the end of the communicative 
skills and enrichment programs? This question addresses the 
Impact of a communicative skills and enrichment program on /poorer 
writers . 

Research Question 2: For officers scoring 40 or higher on 
the initial indirect measure, are there any statistically 
significant multivariate and/or univariate differences in the 
indirect measures of writing skills, the direct measures of 
writing skills, or the cumulative course averages of those 
officers who take the enrichment program in addition to the 
oommunxcative skills program compared to those officers who take 
only the communicative skills program? This question addresses 
the impact of a communicative skills and enrichment program on 
better writers. 
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Btftftrch Qutftion 3: Are thert any statif tically tijnificant 
relationahlpfl between officerf' scoref on the indirect measures of 
writing skills as measured by the Test of Standard Written English 
(TSWE) and the same officers' scores on the direct measures of 
writing skills as de^erAined in the communicative skills program 
of the Military Police Officer Basic Course? This questic.i 
addresses the relationship between the indirect and direct 
measures of writing assessment used in this program. 

Research Question 4: Are there statistically significant 
multiple and/or bivariate relationships between officers' direct 
and indirect measures of vmiting skills vrtien correlated with the 
same officers' cumulative Military Police Officer Basic Course 
averages? This question addresses which method of assessment 
provides the best predictor of performance in the overall 
educational program. 

METHOD 
Subjects 

Subjects for this research were 137 U.S. Army officers who 
were students in the Military Police Officer Basic Course during 
January through June of 1987. The officers were attending their 
initial formal Army tr&lning following commissioning as 
lieutenants. Over half wero members of the reserve components and 
returned to civilian life at the end of the course. 

Demographic data from students attending fiscal year 1986 
classes were analyzed to determine if any demographic categories 
would have a meaningful and significant impact on this study. The 

9 
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only dtMOjlraphic c&ttjory which mtt tht mtaningful (contributing 
over lot of the totul v&ri&nce) and xifnificant (£ < .05) 
r-quirementfl W48 career atatuf. C&reer ftatuf, active versus 
reserve, produced 10.31% of the total variance. The ti|nificance 
level of the career status variable was greater than .0001. 

Officers scoring a scaled score of 40 or above on the TSW^ 
were sorted into groups of active ar>d reserve component officers 
and then were randomly assigned into two experintntal groups based 
on the last four numbers in their social security numbers. All 
officers scoring below a scaled score of 40, Group 3» were 
required to take the enrichment program in accordance with a 
directive which states, officers *not meeting prescribed 
diagnostic standards will take mandatory reBM&dial training 
concurrently with the 16-hour block of instruction* (Department of 
the Army, 1986, August, p. 5). Each of the three groups was 
composed of officers from each of the three classes. 

Programs 

A commur.icative skills progx'am, enrichment program, and the 
relationships of these programs to the cumulative course averages 
in the Military Police Officer Basic Course were analysed in this 
study. A description of each of the programs follows. 

The Military Police Officer Basic Course 

The Military Police Officer Basic Course was a IS-week 
course. The average work week lasted over 56 hours. Periodic 
performance, academic, career progression, leadership, and 
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ptrtonal counttllln| wtre conducted by tuptrvliiort after tht 
academic day wan complttt. 

The Communicative Sklllf Program 

The communicative f kills Intcructlon laited 16 houri. It 
Included two graded writing requirements , the diagnostic Indirect 
assessment, and four more gradc^d writing requirements. 'Basic 
course officers not mee- ' >g prescribed diagnostic standards (a 
scaled score of 40 on the TSWE] will take mandatory remedial 
training concurrently with the 16-hour block of Instruction and be 
dlagnostically retested near course-end* (Department of the Army, 
1986, January, p. 5) . 

The Enrichment Program 

The enrichment program, as the required remedial program was 
called, started after the second hour of the communicative skills 
program and was completed before the eighth hour of the 
communicative skills program. 

The enrichment program consisted of a self-paced programed 
text and classroom instruction. Officers had five scheduled 
meetings with an Instructor. These meetings consisted of a review 
of the assigned enrichment materials, a question-and-answer 
session, and a review to verify the progress of the officers. 
Homework was assigned during the enrichment program. The 
average officer spent 15-20 hours completing the enrichment 
program, Including the homework. 
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Graded Writing AsiiKnntnts 

During the communicAtiv« ikilli progran, oftictri *rtctivt 33 
writing uflignmenti, six of which will bt graded out-of cUii 
written Maignmenta' (0,S, Army Military Poliet School, 108C, 
October » p. E-1) The general initructiona provided to the 
officeri for the graded aiaignmenti included » * The length of your 
writing aagignment la. ifliportant. Your instructor will not 
prescribe an exact length, but your writing muat deal with your 
aubject in aufficient dep^h to be uaeful to a deciaion-maker [and] 
Suapensea aro important in our profeaaion. You muat aubmlt work 
on time* (U.S. Army Militat«y Police Schoox, 1086, January, p. 3). 

The aix graded written asai^nmenta &re writing requirementa 
that a lieutenant frequently will wi'ite once aaaigned to an 
operational military police unit. In thia way, the atudenta 
received inatruction in conaunicative akilla and alao were being 
acclimated to typical dutiea and reaponaibilicies of a new 
officer. 

£ach paper received a grade of auperior» aatlaf actory , barely 
aatiafactory , or unaatlaf actory Additionally, each officer wrote 
an extemporaneoua paper during the firat hour of inatruction. The 
extemporaneous paper waa uaed aa a diagnoatic tool and normally 
waa not graded. The six graded written exerciaea in the existing 
program were used in thia atudy. The relative weight aaaigned to 
each graded writing aasignment waa baaed on the relative 
difficulty and complexity of the aaaignment. 

12 
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Tht aetfaod of aaslgning gT^ades of auperior, satiflfactory , 
barely satisfactory, and unsatisfactory for an exercise was well 
described. The items listed on the Communicative Skills Qrade 
Sheet (Appendix A} did not, by themselves, determine the grade. 
An unsatisfactory paper was not understandable. A barely 
satisfactory paper was an exercise that could be understood, but 
only with difficulty. A as.tisf actory exercise was a paper in 
which the meaning of all parts of the writing exercise was clear, 
but there was one or more parts of the exercise that had 
significant errors. A superior rating was given to a paper which 
met the Army standard of a paper *that can be understood in a 
single rapid reading and is generally free of errors in grammar, 
mechanics, and usage' (Department of the Army, 1065, April, p. 3). 

In the regular communicative skills program, one instructor 
graded all papers for spelling, format, and grammar. This one 
instructor annotated each papers by identifying all spellU<g d^nd 
grammar errors. Feedback was provided to the student o'fi.er for 
spelling errors by inserting the correct spelling. Feedback also 
was provided to the student officer for grammar errors by 
inserting the paragraph number of the paragraph in the Harbrace 
College Handbook (Hodges & Whitten, 1086) in which the error is 
explained. All student officers were given a copy of the Harbrace 
College Handbook for* their use during the course, A second 
grader, the supervisor of the first insc.^uctor, reviewed the 
grades, evaluated style and content, and assigned an overall 
grade . 

13 
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The Teet of Standard Vpitten EnKliah (TSME) 

The TSME was *a 30-minute multiple-cboice examination that 
Q^BB^BB^a the ability to use the conventions of standard written 
English' (Breland, 1977a, p. 1). The TSWE was a product of the 
Educational Testing Service and was designed for initial screening 
for college placement services (Breland, ld77b). 

Scoring on the TSWE was designed tc parallel the Scholastic 

Aptitude Test. Scaled scores on the TSWE range from 20 to 6v.H. A 

TSWE scaled score of 20 to 60 would correspond to Scholastic 

Aptitude Test scaled scores of 200 to 600. Becatise the TSWE is 

designed as a rathur easy test, a Scholastic Aptitude Test score 

above 600 would correspond to a TSWE scaled score of 60^. There 

were two parallel versions of the TSWE. 

Two types of items are included in the TSWE: usage and 
sentence correction. Usage items require recognition of 
writing that does not follow the conventions of standard 
written English; sentence completion items not only require 
recognition of unacceptable phrasing, but also choice of the 
best way of rephrasing the offending sentence component. 
(Cohn. 1985, p" 361) 

Cohn found the TSWE to be a reliable instrument with a 
reliability cf around .66, as measured by the Kuder-Richardson 20 
formula and a median test-retest reliability of .62. Suddick 
(1961) has established the validity of the TSWE for use with older 
students . 

Procedure 

Students proceeded with their normal schedule until after 
taking the initial TSWE. Officers in Group 1, half of those 
initially scoring 40 or above on the initial TSWE, went through 

14 
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tht coBBimicatlve flkills program in the normal manner. Officers 
in Qroup 2, the other half of those initially scoring 40 or above 
on the initial TSWE, went through the communicative skills 
program, with the addition of the enrichment program, in the 
normal manner. Officers in Group 3, those initially scoring less 
than 40 on the initial TSWE, went through the enrichment program 
and the rest of the communicative skills program in the normal 
manner. All groups took a second TSWE at the end of the entire 
communicative skills program and Chen completed the officer basic 
course in the regularly scheduled manner. 

Four graded writing assignments were done after the 
enrichment program. These four writing assignj^nts were used in 
this study to determine the communicative skills score. 

All scheduled students attended all sessions of the enrichment 
program. All students also completed all homework assignments. 

Scoring 

Grading of writing exercises was done independently by the 
class evaluator, the supervisor, and the first author. 

The first author was trained on thn evaluation procedures and 
standards u.^ed by the current evaluators. This researcher spent 
approximately 20 hours on the initial training. 

The first two writing assignments were not used in computing 
overall communicative skills scores because an intervention, the 
enrichment program, was unasrway. However, these two vrriting 
assignments were used as calibration tools and as additional 
training exercises to maintain interrater corsistency. 

15 
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Interrater reliability wi^e determined for each enerciae uaing 
correlation techniques. The .nte?»pat^r reliabilities lor each 
exercise, and for all exercise)? combined, varied from .7195 to 
.9362 and was Jiignif leant {£ < .0001) in each case. 

Results and Discussion 

Each research ques^;ion was analyzed separately, '^he dsta 
analysis and results will be addressed separately for each 
question. All statistical analyses were done on a version of SAS 
designed for microcomputers. 

Research Question 1 

For officers scoring less than 40 on the initial indirect 
measure and who take the communicative skills and enrichment 
programs, are there any statistically significant differences 
between the scores on indirect measures of writing skills, taken 
at the start and at the end of the communicative skills and 
enrichment programs? 

Variables used in evaluating this hypothesis were 
scaled scores on the first TSWE for officers in Group 3 and scaled 
scores on the second TSWE for officers in Group 3. 

Statistical Procedures 

Descriptive statistics for these data were computed. 
(Similar data were also computed iov Groups 2 and 3 for use in 
addressing other questions in this study.) 

Er|c I G 



Collts^ EducAttd Wrlttri 

16 



Thft coupAPlson of *.«ie differences, and the ti^nlflcance of 
the differences, between the Initial and the final T3WE for thoie 
officers \.aklng the e'A!*ldhment program were computed by an 
analyses of variance using an F test. 

Results 

Descriptive data for Initial and subsequent TSWE scores for 
each group and for all groups combined are dlsplayi^d in Table 1. 

Table 1 

DESCHIPTHfE DATA FOR INITIAL AND SUBSEQUENT 
INDIRECT WRITING MEASURES 



Writing measure M SD SE n 



Initial TSWE 



Group 1 




48 


72 


6 


26 


1 


00 


39 


Group 2 




48 


33 


5 


99 


0 


95 


40 


Group 3 




31 


28 


5 


62 


0 


74 


58 


All groups 


(combined) 


41 


.22 


10 


37 


0 


89 


137 


(cond TSWE 


















Group 1 




46 


41 


8 


07 


1 


29 


39 


Group 2 




47 


92 


8 


39 


1 


36 


38 


Group 3 




34 


.75 


8 


.91 


1 


.18 


37 


All groups 


(combined) 


41 


.88 


10 


.48 


0 


.91 


134 



The mean score of the indirect measures of writing skills 
taken after the enrichment program (34.75) is significantly higher 
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than tht Man gcoft of the indirect measures of writing skills 
taken before the enrichment program (31.28) for officers in Group 
3, F{1,55) = 29.85, £<.0001. 

Besearch Question 2 

For officers scoring 40 or higher on the initial indirect 
measure, are there any statistically significant multivariate 
and/or univariate differences in the indirect measures of writing 
skills, the direct measures of writing skills, or the cumulative 
course averages of those officers ^o take the enrichment program 
in addition to the communicative skills program compared to those 
officers «rtio take only the communicative skills program? 

Variables used in evaluating this hypothesis were cumulative 
weighted and combined score on exercises three, four, five, and 
six for officers in Groups 1 and 2; the scaled scores on the final 
TSWE Icr- officers in Groups 1 and 2; and cumulative course 
averages fcr officers in Groups 1 and 2. 

Statistical Procedures 

Descriptive statistics for each of these data were computed. 
(Similar data were also computed for Group 3 for use in addressing 
other questions in this study.) A multivariate analysis of 
variance and a Wilks' lambda then were used. The multivariate 
analysis of variance also produced measures of significance, 
evaluated by a series of F tests. The dependent measures were the 
indirect and direct measures of writing skills and also the 
cumulative course averages. The independent variable was taking, 

18 
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or not taking, the enplchment program (placamant In Group 1 or 
Group 2) . 

Beaultg 

Descriptive data for Initial and subsequent direct measures 
of writing skills are displayed in Table 2. 

Table 2 

DESCRIPTIVE DATA FOB INITIAL AMD SUBSEQUEMT 
DIRECT WRITING MEASURES 



Writing measure U SE n 



Diagnostic exercise^ 



Oroup 1 




2. 


12 


0. 


.80 


0. 


13 


37 


Oroup 2 




2. 


16 


1, 


.10 


0. 


16 


40 


Oroup 3 




1. 


,33 


1. 


.03 


0. 


14 


58 


All groups 


(combined) 


1, 


.79 


1. 


.04 


0. 


09 


135 


!l|hted and combined score^ 












Oroup 1 




379. 


.97 


82 


.72 


13. 


.25 


39 


Oroup 2 




413. 


.68 


65 


.89 


10. 


.69 


38 


Group 3 




348. 


,05 


72 


.77 


9. 


.64 


57 


All groups 


(combined) 


376 


.38 


78 


.19 


6. 


.75 


134 



•Scores for writing exercises were 0 (for unsatisfactory), 1 (for 
barely satisfactory), 2 (for satisfactOi^y) , or 3 (for superior). 
^The total possible weighted and combined points were 480. 
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Thti^t if no statiBtically tign.UiCAnt multivArlAtt difference 
when comparing the indirect and direct meaaurea of writing akiUa 
and the cumulative course averages baaed on whet^<ir or not 
officers took the enrichs^nt program in addition to the regular 
communicative skills program. When comparing officers in Group 1 
to officers in Group 2, the only variable which approaches 
significance is the direct measure of writing skills, F(l,75) = 
3.90, * .0520. However, because there is no significant 
multivariate difference, F(3,73) - 1.73, = .1669, the univariate 
differences are assumed to be a result of chance occurrence. 

Research Question 3 

Are there any statistically significant relationships between 
officers' scores on the indirect measures of writing skills as 
measured by the Test of Standard Written English (TSHE) and the 
aame officers' scores on the direct measures of writing skills as 
determined in the communicative skills program of the Military 
Police Officer Basic Course? 

Variables used in evaluating '^his hypothesis were scores on 
the first diagnostic writing exercise; scaled scores on the first 
TSWB for all officers; the cumulative weighted and combined score 
on writing exercises three, four, five, and six; and the fsecond 
TSWE scaled scores for all officers. 

Statistical Procedures 

Initial indirect and uirect measures of writing skills were 
flummarized and analyzed using standard descriptive statistics. 
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IndiPftct And dirtct meASurtf of writing skills compltttd afttr the 
enrichment p'x«o|ram alto were fiimmarized and analyzed ufing the 
same procedures. Correlations of the diagnostic writing exercise 
to the first TSWE for all three groups combined were derived and 
then analyzed using correlation analyses and a F test. 
CoBq)arison8 of the cumulative weighted and combined scores on the 
last four graded writing exercises to the scaled scores on the 
second TSWE for all three groups combined also were derived and 
then analyzed using correlation analyses and a F t^st. 

Correlations relating either the first or the second TSWE to 
each group separately were not computed since the basic design 
used in defining the group limited the range of scores for each 
group on the initial TSWE. 

Houston has suggested determining a coefficient of 
determination and an index of forecasting efficiency for use in 
determining the efficacy of relating different instruments. The 
coefficient of determination is the amounl of the variability of 
the dependant variable (s) that can be predicted from che 
independent v^riable(s). The index of forecasting efficiency is a 
measure of the improvement, if any, in the prediction how well 
subjects would do on the dependant measure (s) based on the score 
on the independent measure (s) compared to a random estimate. The 
coefficient of determination and the index of forecasting 
efficiency were determined for all three groups combined for both 
the initial and the second TSWE. 
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Beaultg 

Thare is a significant overall relationship between officers' 
scores on the initial indirect measure and the same officers' 
scores on the initial direct measure of writing skills. 
Additionally, there is a significant overall relationship between 
officers' scores on the subsequent indirect measures and the same 
officers' scores on the subsequent direct measures of writing 
skills. These data are displayed in Table 3. 

Table 3 

RELATIONSHIPS BETWEEN DIRECT AND INDIRECT 
WRITING MEASURES BEFORE AND AFTER 
THE ENRICHMENT PKOQRAM 



All groups combined r £ £D IF 



Before enrichment .4469 <.000l .1997 .1054 

After enrichment .4154 (.0001 .1725 .0904 



Note. CD is the coefficient of determination. IF is the 
index of forecasting efficiency. 

Research Question 4 

Are there statistically significant multiple and/or biv^riate 
relationships between officers' direct and indirect i&easures of 
writing skills when correlated with the same officers' cumulative 
Military Police Officer Basic Course averages? 
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VAfiAbUs ueed in ev4lu4tinj this hypotheiis wtft cumulative 
course average for officers in Qroups 2 and 3; cumulative weighted 
and combined score on writing exercises three through six for 
officers in Q^oupa 2 and 3; and scores on the second TSWE for 
officers in Groups 2 and 3. 

Statistical Procedures 

Descriptive data for the cumulative course average were 
computed for officers in each group and for all three groups 
combined and analyzed using standard descriptive procedures. 
(Although data on the cumulative course average for Group 1 are 
not needed to address this question, these data art needed later 
in this study.) Descriptive data for the direct and indirect 
measures of writing skills subsequsnt to the enrichment program 
were already computed. 

The relationiihips between the cumulative course averages and 
the cumulative weighted and combined scores on writing exercise'i 
three, four, five, and six and between the second TSWE scaled 
scores were then computed using stepwise multiple regression 
analysis and then analyzed using correlation analyses and a F 
test. Separate F tests were used to analyze the relationship 
between the each variable entered into the equation and to analyze 
the significance of the change in the relationship when the second 
variable was entered into the equation. 

Results 



Shown in Table 4 are descriptive data for the officers' 
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ctmulAtlvt courte Avcraget, by froup and for all groupf combined. 
Data for offlccrf In Qroups 2 and 3 wtrt ufed In addrtfslng thli 
research question. Data for officers In Qroup 1 mv% not used In 
the analysis of this question because their ran^e of skills is 
restricted based on the results of the initial indirect measure of 
writing skills. Descriptive data for the officers in Qroup 1 are 
shown, however, because of the relevancy in addressing other 
questions . 

Table 4 

DESCRIPTIVE DATA FOR THE COITOLATIVE 
OFFICER BASIC COURSE AVERAQES 



aroup number U SD SE n 



Qroup 1 


88. 


.90 


4. 


.38 


0. 


.70 


39 


Qroup 2 


88. 


.48 


3. 


.53 


C. 


.57 


38 


Qroup 3 


85. 


,79 


4. 


.52 


0. 


.60 


57 


All group! (combined) 


87. 


.48 


4 


.44 


0. 


.38 


134 



The cumulative course averages for Qroups 2 and 7 were 
compared using stepwise multiple regression techniques to a model 
combining the direct and indirect measures of writing skills and 
theif to the direct and indirect measures separately. Tnere is a 
statistically significant relationship between the indirect 
measures of writing skills and the cumulative course average, 
P(l,93) - 40.46, 2 <.0001. When the data for the direct measures 
of writing skills are added to the model, there is a statistically 

,24, 
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lifnificAnt rtlationfhip btiMtn the combined Mi4iuP€f of writing 
skills and the cumulative course averages for officers in Qroups 2 
and 3, F{2,92) - 20.59. e. <-001. However, the incre»ent-^l 
improvement in the prediction model, resulting from tLe incll^^lon 
cf the direct measures, is not significant, F(2,02) = 0.S5* £ 
>,05. 

GENERAL DISCUSSION 

This study's findings show that the enrichment program did 
significantly improve writing skills of officers initially getting 
lower scores on the initial indirect measure of writing skills, 
although the enrichment program did not improve the writing skills 
of officers initially scoring higher on the initial indirect 
measure or their performance in the overall course. The Mderate 
and typical relationship between indirect and direct assessment 
techniques was confirmed, at least for the instruments used in 
this study. Also, the indirect assessments have essentially the 
same ability to predict overall course averages as the combined 
use of indirect and direct measures. This statement supports the 
conclusion that those who improve their writing periormance will, 
in fact, improve their performance in educational programs in 
general . 

Other important issues remain regarding the writing of 
college educated professionals. Additional data are needed in the 
area of relating communicative skills to success of college 
educated professionals. Effective communicative skills are 
assumed to be a requirement for success, but empirical data to 
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fupport thli: AffUBptlon &pe limited. Additional oata artt aluo 
needed on the value of exifting college curricula. Many of the 
coBq>laint8 are concerning college educated profeiiionali . If 
writing skills are required for profeiiional lucceis, and college 
is the gateway to the profcffional world, then existing college 
couriei need to be evaluated for their ^Xiectiveneia in meeting 
the needs of their students. 

Alternative curricula for communicative skills and remedial 
enrichment programs should be investigated for their application. 
David and Stine (1984) showed significant improvements in writing 
based on a short course similar to the course in this study; yet 
there are mixed results concerning significant improvement in 
writing skills resulting from the communicative skills course in 
this study. Alternative curricula for remedial enrichment 
programs also ^^ed a significant amount of additional research. 

In conclusion effective writing p?ograms would significantly 
improve the productivity of college educated professionals. They 
would significantly improve productivity and save millions of 
dollars annually. 
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APPEMDIX A 
COMMmilCATIVE SKILLS 
QRADE SHEET 
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ommiCATXVE skills grade sheet 

AssiffoKnt: 

STtsc: 

Coarse: 

Faoslty Adviser: 
Oarity Index: 



Subst&ncg 

_ lojidei^te 

Kain idea poorly supported 

Unity lackinf 

Other sajor errors 

Organisation 

Purpose unclear 

lUin idea not isctediately apparent 

Coherence laclcing 

Other Mjor errors 

Style 

Verbose 

Too auch jargon 

Too wany long words 

Too «any weak verbs 

Excessive use of passive voice 

Sentences too long 

Paragraphs too long 

Other aajor errors 



Correctness 

Errors in spelling 

Errors in sentence construction 

Errors in punctuation 

Other «a}or errors 



— Key to Correction Synbols — 

S misspelled word 

Frag sentence fragnent 

CS coKoa splice 

Ref tsndear pronoun reference 
— delete 

^ fataty parallelisa 

SC iiqiroper sentence construction 

Cap inproper capitalization 



Evaluation 

Superior 

Satisfactory 

Barely Satisfactory 

Unsatisfactory 



p improper punctuation 

Agr faulty subject-verb agrecaent 

Pas inappropriate use of passive voice 

W wordy 

Ji eaission 

Ong/W dangling or nisplaced modifier 

U inproper usage 



